Efficient Transmission and Rendering of RGB-D Views

نویسندگان

  • Zahid Riaz
  • Thorsten Linder
  • Sven Behnke
  • Rainer Worst
  • Hartmut Surmann
چکیده

For the autonomous navigation of the robots in unknown environments, generation of environmental maps and 3D scene reconstruction play a significant role. Simultaneous localization and mapping (SLAM) helps the robots to perceive, plan and navigate autonomously whereas scene reconstruction helps the human supervisors to understand the scene and act accordingly during joint activities with the robots. For successful completion of these joint activities, a detailed understanding of the environment is required for human and robots to interact with each other. Generally, the robots are equipped with multiple sensors and acquire a large amount of data which is challenging to handle. In this paper we propose an efficient 3D scene reconstruction approach for such scenarios using vision and graphics based techniques. This approach can be applied to indoor, outdoor, small and large scale environments. The ultimate goal of this paper is to apply this system to joint rescue operations executed by human and robot teams by reducing a large amount of point cloud data to a smaller amount without compromising on the visual quality of the scene. From thorough experimentation, we show that the proposed system is memory and time efficient and capable to run on the processing unit mounted on the autonomous vehicle. For experimentation purposes, we use standard RGB-D benchmark dataset.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Robust Real-Time Registration of RGB-D Images using Multi-Resolution Surfel Representations

Fast and robust registration of 3D scans is required in many approaches to perception in robotics such as pose tracking or simultaneous localization and mapping. We propose a novel efficient method to register RGB-D images. We convert the image content into a multi-resolution surfel representation and exploit the dense image neighborhood to construct such views at high frame-rates on a single C...

متن کامل

Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor

This paper proposes a new easy and fast 3D avatar reconstruction method using an RGB-D sensor. Users can easily implement human body scanning and modeling just with a personal computer and a single RGB-D sensor such as a Microsoft Kinect within a small workspace in their home or office. To make the reconstruction of 3D avatars easy and fast, a new data capture strategy is proposed for efficient...

متن کامل

Matterport3D: Learning from RGB-D Data in Indoor Environments

Access to large, diverse RGB-D datasets is critical for training RGB-D scene understanding algorithms. However, existing datasets still cover only a limited number of views or a restricted scale of spaces. In this paper, we introduce Matterport3D, a large-scale RGB-D dataset containing 10,800 panoramic views from 194,400 RGB-D images of 90 building-scale scenes. Annotations are provided with su...

متن کامل

Joint Depth/Texture Bit-Allocation For Multi-View Video Compression

Multi−View display technology allows the presentation of a 3D video by showing simultaneously several views of the same scene. One approach to render these multiple views is to synthesize novel views using a Depth Image Based Rendering (DIBR) algorithm. Consequently, for the efficient transmission of 3D video signals, the compression of texture and also the depth images is required. Since the r...

متن کامل

Spectralization: Reconstructing spectra from sparse data

Traditional RGB reflectance and light data suffers from the problem of metamerism and is not suitable for rendering purposes where exact color reproduction under many different lighting conditions is needed. Nowadays many setups for cheap and fast acquisition of RGB or similar trichromatic datasets are available. In contrast to this, multior even hyper-spectral measurements require costly hardw...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013